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Thei ntroducd on of an i ni ti al teacher certi fi cati on test! n Ontario i n 2CD2was metby a wide 
range of responses from preservi oe teachers. This study, based on an April 23D2survey 
of 535 preservice teachers in a large initial teacher education program, describes the 
rel ati onshi ps among whatthe parti d pants knew abou tthe Ontari o Teacher Qual i fyi ng T est, 
thei r previ ous experi ences wi th other I arge-scal e tests, and thei r bel i efs abou tand atti tud es 
toward the test 
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L'introductiond'unTestd'aptitudealaprofession enseignanteen Ontari oen 2]02asusdtB 
tout un eventail de reactions de la part des candidats a I'enseignement Cette etude, 
effectueealasuited'unsondagemeneenavril 2302aupresde 535candidatsinscritsdans 
un vaste programme de formation a I'enseignement decrit les liens entre oe que les 
parti d pants connai ssai entd u Testd'apti tude a I a profess! on ensei gnante de I ' Ontari o, I eu rs 
experi en ces anted eu res avecd'autres tests a grande echelleetleurscroyanoesetattitudes 
au sujetdeoetesten particulier. 

Mots des : formation a I'enseignement certification a titred'enseignant preparation en 
vued'un test analyse factor! elle 


In much of North America, candidates for teaching certificates must pass 
a certification test or tests. Thesetests vary in content — general pedagogy 
and/or subject-specific knowledge — and in format — paper-and-pendl 
tests, performance assessments, portfolio assessments, or some 
combination. Many of the tests have been controversial and much has 
been written about their history, passing criteria, and impact on pre- 
service teachers and teacher-education programs. 

Anyone who has worked with preservice teachers in a Jurisdiction 
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with a certification test can attest that their responses to the prospect of 
taking such a test vary. Some seek out information about the test others 
avoid discussing it Some believe that such tests are well -constructed and 
fair; others are deeply skeptical. Some plan to prepare for the test others 
believe that preparation is unnecessary. Some believe that poor 
performance on thetestshould have serious consequences; others do not 
Some believe that teacher -education programs should explicitly help them 
prepare for the test others feel thatindividual preservice teachers should 
take responsibility for their own preparation. 

Few studies have systematically explored preservice teachers' 
experiences and perceptions of certification tests (see, however, Bower, 
2303 Portelli, Solomon, & Mujawamariya, 2303). None has examined the 
relationship between students' experiences and their perceptions. 
Specifically, how does preservice teachers' exposure to information about 
the test and their experiences with other large-scale assessments relate to 
their beliefs about and attitudes toward a certification test? This study 
explores these relationships for preservice teachers taking a new initial 
teacher certification test in Ontario (currently the only one in Canada). 
U nderstanding how preservice teachers vary in their knowledgeand beliefs 
about and attitudes toward the test and in their previous experiences 
with large-scale tests may help teacher -education programs plan test 
preparation activities. Understanding the relationships among their 
experiences and perceptions may suggest how to design activities for 
groups of preservice teachers. 

INITIAL TEACHER CERTIFICATION TESTING 

In 1871, Ontario introduced its first province-wide initial teacher 
certification test Prior to 1871, most teachers had been certified by county 
boards, which issued county -specificteaching certificates based on widely 
varying standards. A few teachers, seeking certificates that would bevalid 
province-wide, had attended the Normal School i n Toronto, theonly formal 
teacher -education program at that time. 

The 1871 test was administered over six days, with six hours of testing 
per day, and covered education theory and practice, and specific subjects 
such as algebra, geography, and English grammar — content parallel to 
thatof the Normal School's final exams. By 190Q more teacher -education 
programs existed and most preservice teachers were certified based on 
their performance in those programs. In 1908 theprovindal government 
abolished the boards responsible for the provincial tests. 
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In 2001, Ontario began developing a new initial teacher certification 
test the Ontario Teacher Oualifying Test; it was administered for the first 
time in April 2002 Beginning in 2C03, preservice teachers had to 
successfully complete an accredited teacher -education program and pass 
the test to receive their teaching certificates. U nl ike the 1871 test the new 
test does not measure subject knowledge; instead, it measures general 
"professional knowledge" and "teaching practice" (Educational Testing 
Service, 2001). The test four hours long, consists of multiple-choice 
questions and case studies accompanied by short answer questions. 

Ontario is not alone in testing teachers prior to certification. Between 
1977 and 1987, the number of U .S. states requiring candidates to write a 
licensure test increased from Sto 44 (Porter, Youngs, & Odden, 2001); in 
1908 42 states included at least one test as a certification requirement 
(National Research Council, 2001). Shanker (190Q attributes much of the 
increase in testing to concerns about the variation in teacher -education 
programs and the desire to set dear standards. Indeed, in 1987, the newly 
formed U.S. National Board for Professional Teaching Standards 
recommended that teacher certification requirements indude testing of 
subject matter and pedagogical theory and practice, in a move toward 
implementing professional standards at education faculties across the 
country. Since the U.S. government created the "Teacher Quality 
Enhancements Grants for States and Partnerships" in 1998 teacher 
preparation programs with low passing rates on their state-mandated 
tests risk not being able to enroll students who receive federal finandal 
aid. 

Test format Most tests in the 197C6 were multiple-choice. As Porter, 
Youngs, and Odden (2001) note in their review of the literature, some 
educators charged that multiple-choice questions about professional 
knowledge were often based on over -simplifications, so that " the greater 
a candidate's knowledge of how [dassroom organization, teaching 
strategies, and instructional goals can affect] teaching, the more likely he 
or she was to havedifficulty answering thesequestions" (p. 261). Thereis 
littleevidencetD either supporter disprove this assertion, however. Many 
of the recent tests indude other types of items. Some incorporate portfolio 
assessments, performance assessments, or case studies requiring written 
responses. For example, the Interstate New Teacher Assessment and 
Support Consortium, created in 1987by theCoundl of Chief State School 
Officers, the U.S. organization analogous to the Council of Ministers of 
Education Canada, is developing a performance assessment and written 
test for new teachers (Porter, Youngs, & Odden, 2001). 
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Test validity. Are initial teacher certification tests good measures of 
beginning teacher competence? Based on its review of the literature, the 
National Research Council (2001) concluded: 

Little research has been conducted on the extent to which scores on current teacher 
licensure tests relate to other measures of beginning teacher competence. Much of the 
research thathas been conducted suffers from methodological problemsthatinterferewith 
maki ng strong cond usi ons aboutthe resul ts. Thi s makes i t hard to determi ne whateffect 
licensure tests mighthaveonimprovingtheactual competenceofbeginning teachers, (p. 
135 ) 

Of particular concern in many jurisdictions is the possibility that 
different certification standards might result in better student 
performance. Strauss and Sawyer (190^ found, for school districts in North 
Carolina, that as a district's average teacher certification test scores 
increased, students' reading and math scores also increased, and the failure 
rate on high-school competency tests decreased. The effects were very 
small, however, and itis unclear whether the higher teacher scores caused 
the improved student performance or teachers with higher scores were 
attracted to schools with higher performing students. 

Goldhaber and Brewer (200Q used multiple regression to explore 
whether state certification standards had an impact on student I earning. 
An analysis of data collected from grade-12 public school students in 
mathematics and science, and from teachers of mathematics and science, 
most of whom were certified in subject areas, found that students who 
had teachers with mathematics degrees had higher mathematics test 
scores, although the same was not found to be true in science. Teachers 
with doctoral degrees did not appear to further improve student test 
scores. Teachers with undergraduate degrees in education were found to 
havea negativeimpacton studentmathematics scores. The typeof teacher 
certification (i.e., emergency or standard) did not affect student scaares in 
mathematics and science. 

Darling-Hammond (20CD) examined the relationship of a state's 
percentage of teactiers with full certification and a major in their field 
with student actiievement on the National Assessment of Educational 
Progress (NAEP). States with higher percentages of highly qualified 
teachers had significantly better student scores in reading and 
mathematics in both grades 4and 8 

The combination of high stakes for preservice teachers — and, 
increasingly, teacTier -education programs — and scant validity evidenca, 
particularly for tests of general pedagogical knowledge, not subject matter 
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knowledge, have caused initial teacher certification tests to be very 
controversial. Hess (200^, for example, describes a range of proposals, 
from cal I s for no certi fi cati ontodemandsforadditional certi fi cati on cri teri a. 

Test preparati on. Whether prepari ng preservi ce teachers to take the test! s 
the responsibility of the initial teacher -education program, the teacher 
candidate, an organization such as the Ontario College of Teachers, or 
some combi nation isnotdear. McDonough and Wolf (1967) reviewed U.S. 
case law and psychometric standards relevant to teacher testing and 
predicted: 

In future cases litigants may daim thatthey did not have a fair opportunity to prepare for the 
test States may havetojustify teacher education programs thata state approved butthat 
are notable to prepare students who can pass the tests. They may also have to show that 
students were given adequate warning that the testwas to be required. They may pointto 
publicationofstudy ot^ectivesand liberal reexamination pol ides as state efforts to honour 
test-takers' rightof due process, (p. 211) 

In McDonough and Wolfs view, teacher-education programs would be 
wise to consider helping preservice teachers prepare for the tests. 

Even if teacher -education programs intend to prepare preservice 
teachers to take the tests, doing so can prove difficult I nformation about 
the tests content is often not readily available. For example, Zigo and 
Moore (200^ describe how they coped, as teacher educators, with the lack 
of information available about one of the Praxis tests, a required step in 
the initial certification process in Georgia. After reviewing materials 
available from the test publisher in printed copy and on its website, Zigo 
and Moore began to ask their students about the test They report that this 
strategy was not very successful for three reasons: (a) different forms of 
the test were used, (b) students’ recollections were inconsistent and (c) 
students' recollections seemed todepend on their perceptions of personal 
weaknesses in the content the test was measuring. 

Zigo and Moore (220^ subsequentiy took the test themselves. They are 
not alone in resorting to this strategy to find out what the preservice 
teachers are facing (see, for example, Bowen, 2002 Luna, Solsken, & Kutz, 
2CCO). They found that some of the items were based on theories that were 
inconsistent with their understanding of established professional 
standards. Furthermore, they felt that the use of a multiple-choice item 
format made the test confusing. Zigo and Moore i ncorporated what they 
learned from taking the test into their program by providing students 
with a variety of test preparati on activities, such as information sessions, 
direct instruction, and test review. 
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Bowen (ZE^writEsoftierexperienceattendinga Praxisll testofEnglish. 
She was motivated by her awareness, as an English professor and assodate 
dean, that teacher -education programs are not always successful at 
preparing students for certification exams. Bowen observes that 
preservice teachers continue to rely on teacher -education programs to 
provide them with sulyect-spedfic knowledge in addition to pedagogical 
knowledge and skills. She suggests that English departments, regardless 
of their philosophical position on testing, should take active roles in 
preparing students for certification examinations, something she believes 
would benefit teacher -education programs, teacher educators, and 
preservice teachers. 

Luna et al. (20CD) describe the difficulty educators may face when 
preparing preservice teachers to take a test that is based on an opposing 
pedagogical approach. For them, the Communication and Literacy Skills 
(CLS) section of the Massachusetts Educator Certification Tests presented 
such a quandary. Luna etal. developed a three-part activity for "situating, 
unpacking and critiquing" high stakes tests. The "unpacking" partof their 
workshop provided students with a structured set of questions designed 
toprovidean understanding oftheform, purpose, process, and evaluation 
ofliteracy practices. The students were then encouraged tD"critique" the 
CLS usi ng the same questions, " maki ng the norms and expectations of the 
CLS testing situation explidt' (Luna etal., 2X1Q p. 28^. The preservice 
teachers who exami ned theCLStestitemsand scoring criteria commented 
on the dosed nature of the scoring even in the short answer response 
items, and were able to identify a "pre-spedfied format' which left test 
takers with little autonomy in their responses. Luna etal. reported that 
preservice teachers who understood the nature of the CLS test were more 
likely to pass by using theirknowledge and skills to break down complex 
subject matter to structure answers to discrete questions. 

Delandshere and Arens (2X)1) explored the effects of certification 
standards on teacher-education programs in two states chosen for their 
different approaches. After reviewing numerous documents and 
interviewing 41 teacher educators, the authors conduded that each of the 
programs was being aligned with the certification standards and test 
sped fi cations. Partidpants who did not incorporate the standards into 
thei r assessment p racti ces were i d enti fiedduringthe accred i tati on p rocess, 
and received poor evaluations. Clearly, the pressure for initial teacher- 
education programs to prepare preservice teachers to take certification 
tests raisesdifficultissuesaboutprograms' autonomy and responsibilities. 

Impacts on preservice teachers. As the preceding section suggests, initial 
teacher certification tests can affect the preparation preservice teachers 
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receive. In addition, individual preservice teachers must pass the test or 
tests to receive their teaching certificates. This may be more difficult for 
some preservice teachers than for others. Numerous studies have focused 
on the pass rates of subgroups of preservice teachers by race or ethnicity. 
A study by the N RC (2001), for example, obtained data for 12states from 
thePraxislI: Prindples of Learning and Teaching (PLT) test for 1906/1909 
Analyzing the passing rates by radal/ethnic group, the NRC found that 
the average passing rates ranged from 46% for African American preservice 
teachers and for Hispanic Americans, to 62% for Asian Americans, 
and 86% for those who reported their race as White. Itis important to note 
that although the same testis used in these states, each state sets its own 
passing score; the N RC applied each state’s passing score to its preservice 
teachers. The NRC report also summarizes work by other researchers 
who worry that pedagogical knowledge tests, such as the Praxis II: PLT, 
may be particularly susceptible to bias against non-majority groups: 
"Items or expected responses that overgeneralize notions a bout effective 
teaching behaviors to contexts in which they are less valid may unfairly 
disadvantage minority candidates who are more likely to live and work 
i n these sett ngs" (pp. 110-111). 

Latham, Gitomer, and Ziomek (199^ discuss ongoing concerns with 
thelack of gender and ethnicdiversity among preservice teachers, and the 
problems that could emerge as a result of pladng further certification 
demandson an already stressed profession. They examined theSAT scores 
of students who had passed the Praxis II and found they had higher 
academicskillsthan thegeneral population. One exception was preservice 
teachers seeking the elementary education licence, who were found to 
have scores "substantially lower than . . . those seeking I i censure in specific 
content areas" (Latham, Gitomer, & Ziomek, 1909 p. 25). 

Impacts cn initial teacher -education programs. Oneimpacton teacher -education 
programs has already been discussed: the pressure to align curricula with 
a tests content The threat of losing funding if preservice teachers do not 
perform well on the testmay motivate other changes. For example, Flippo 
and Riccards (2200) studied the effects of the controversial Massachusetts 
Educator Certification Tests on teachers and on teacher-education 
programs. During the firstyear of the tests, of the preservice teachers 

failed, with the result that only six of the 55 state-certi fi ed , teacher- 
education programs received accreditation. Massachusetts’ Department 
of Education was forced to seta three-year implementation period to 
provide time for teacher-edu cation programs to meet the demands of the 
test. Teacher-education programs in Massachusetts have since 
implemented entrance exams to screen preservice teachers, and aligned 
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curricula tD indudedirect teaching te the test both steps thatFlippo and 
Riccards (20CD) fear may further reduce the diversity of teachers entering 
the p rofessi on. T he negati ve p ress rel eases su rrou nd i ng the ad mi ni strati on 
of the test were also expected to further dissuade prospective teachers 
from entering the profession. 

THISSTUDY 

To understand the relationships among what preservice teachers know 
aboutan i ni ti al teacher certi fi cation test thei r past exp eh ences wi th testi ng, 
and their current beliefs and attitudes, we surveyed preservice teachers 
preparing to take a new licensure test The questions of interest were: 
What are preservice teachers' experiences and perceptions of an initial 
teacher certification test? and How do their experiences relate to their 
perceptions? 

METHOD 

Subjects 

I n A p ri I 2C02, two weeks before the 0 ntari o T eacher QualifyingTest(OTQT) 
was administered for the first time, several hundred preservice teachers 
atthe Ontario I nstitutefor Studi es i n Education of theU ni versity of Toronto 
(OISEAJT) partidpated in faculty -sup ported workshops about the test 
An exact count of those who attended the workshops, unfortunately, is 
not available. Estimates, based on thecapadty of the auditorium in which 
the sessions were held, place the total number at about GOO Of those 
attending, 552 returned a questionnaire. Seventeen questionnaires were 
more than ECP/o blank and so were dropped from the dataset leaving 535 
questi onnai res for analysi s. Of the remai ni ng questi onnai res, 72% i nd uded 
no omitted questions and 9^ omitted two or fewer questions. In the 2301/ 
2302academicyear, 1,190preservice teachers were enrolled inOISEAJT's 
Primary/Ajnior, Jjnior/Intermediate, and Intermediate/Senior programs. 
(Candidates for technical studies degrees or diplomas were not required 
to take the OT OT, so are noti nd uded i n thi s cou nt) The 535questi onnai res, 
therefore, represent 4^ of the preservi ce teachers i n 01 SE AJ T's programs 
to which the test applied. 

Because the workshops were voluntary, the respondents cannot be 
considered a random sampleffom thestudentbody. However, theindusion 
of demographic questions permits comparisons of the respondents to all 
p reserv i ce teachers at 01 SE AJ T. Seventy -ei ght percentof respond ents were 
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female. This is similar tD the 76% in the OISEAJT program. Thirty-three 
percentof respondents were from the Primary/Jjnior program, ISpercent 
from the Junior /I ntermediateprogram, and just over SOpercentfrom the 
I ntermediate/Seni or program (a few respondents did notprovideprogram 
information). These percentages are similar to those for all preservice 
teachers: 23^0, ^&/o, and 54%. 

Instrument 

The questionnaire was developed specifically for use as part of the 
workshops. Items were created based on (a) feedback from earlier 
workshops with smaller groupsof preservice teachers, (b) an examination 
of e-mail messages in an on-line forum about teacher testing, and (c) the 
themes thatemerged from the I iterate re review. Items addressed preservice 
teachers’ exposure to the OTQT, past experiences with large-scale 
assessments, and perceptions of the OTQT. The exposure and experience 
items had responseoptionsofyes," "no," and, for someitems, "notsure" 
or"somewhat" Response options for the perception items were "strongly 
disagree," "disagree," "agree," "strongly agree," and "don'tknow." 

D escri pti ve Stati sti cs 

T he percentages of p reservi ce teachers respond i ng posi ti v el y to experi ence 
questions were computed. In addition, the percentages of preservice 
teachers disagreeing O-e., selecting "disagree" or "strongly disagree"), 
agreeing O.e., sel ecti ng " agree" or "strongly agree"), and responding "don't 
know" for each perception item were computed. 

Factor Analysis 

To identify patterns of responses, the perception items were subjected to a 
factor analysis. In preparation for the factor analysis, the response options 
werecoded 1to5for"stronglydisagree," "disagree," "don'tknow," "agree," 
and "strongly agree," respectively. "Don'tknow" was included as the 
middle point on the scale for the factor analyses to maximize the number 
of analyzable responses. Because even this recoding yields only five 
response options, polychoric correlations, rather than Pearson product- 
momentcorrelations, were computed (for items with few response options, 
Pearson product-moment correlations tend to be underestimates; see 
Mislevy, 190^. Maximum likelihood extraction and promax rotation were 
used. Both the convention of keeping only those factors that have 
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eigenvalues greater than one and examination of the scree plot suggested 
fivefactors. A few items thatdid notload on any ofthe factors or loaded on 
two or more were dropped from the analyses. 

RESULTSAND DISCUSSION 

Experiences 

Preservice teachers' exposure to information about the OTQT is 
summarized in Table 1. Almost all (94.4%) ofthe respondents reported 
having been in a class or workshop in which the test was discussed. 
However, fewer had actually seen the publicly available information. 
Although 44.1% had read the test specifications and 634% had read the 
available example case studies or had seen case studies through 
partidpating in the pilot or field test for the OTQT, only 348% had seen 
both and 267% had seen neither. Only half (50 reported having actively 
sought primary information about the test; that is, having visited the 
websites of the organizations that created the test (the Ontario Prindpals' 
Coundl [0 PC], in collaboration with the Educational Testing Service [ETS]) 
or of the tests sponsor (the Ontario Ministry of Education [OMOE]). In fact 
17.2% reported having seen none of these — sped fi cations, cases, or 
websi tes. 


Table 1 

PreservioeTeachers' Experiences 


Percentage 


Exposureto 1 nfbrmati on A bouttheOTQT 

Experienced dass discussions or workshops about the test 

944% 

Read the test sped fi cations 

44.1% 

Read example and/or draft cases 

634% 

Visited the Ontario Prindpals' Coundl and/or Ontario 
Ministry of Education websites for information aboutthetest 

505/0 

Past Test-Taking Experience 


Had taken a standardized test(e.g., SAT, GRE, LSAT, GMAT, 
MCAT) si nee hi gh school 

14.2% 
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ThetEstspedfications were first made aval I able tD OISE AJT students in 
November 200], when they were posted in electronic form on an intranet 
discussion group labeled "Teacher Testing Forum." They were distributed 
in paper form in February 20C£ata panel discussion organized by the 
OISEAJT StudentTeachers' Union. The example case studies were posted 
on the OPC’s website by February 2302 They were also distributed by 
some OISE/UT instructors in their classes. 

The I nternet was an important source of information about the test 
Both OPC and ETS posted OTQT information on their websites. TheOMOE 
posted press releases and other information aboutthetest 

In addition to discussions that took place within regular classes, a 
number ofOTQT workshops, forums, and discussions were held atOISE/ 
UT to address student and faculty concerns. The dean's office held five 
policy forums between October 2301 and March 2302 TheStudentTeachers’ 
Union sponsored a panel discussion in February and a demonstration in 
frontof the provincial legislature building in March 2302 

A sTabI el also reports, only 14. 2% of preservice teachers reported having 
taken a standardized test, such as the SAT, the Graduate Record 
Examination, or similar tests, since high school. Since the late 19606, 
entrance to universities in Ontario has been based on marks, rather than 
on admissions tests. Itis likely that only individuals who graduated from 
high school outside Canada or considered attending school elsewhere 
would have experience with such tests. 

Percept cns 

Factor Analysis. Theanalysisoftheperception itemsyielded fivefactors. 
Table 2 presents the correlations of the individual statements with the 
factors, corrected for the correlations among the factors. Table Spresents 
the correlations among the factors. 

An examination of the statements loading on each factor suggests that 
the fi rst factor concerns the Utility of the test the second factor concerns 
Preparation by preservice teachers to take the test the third factor concerns 
the possibility of having Other Tests as well as or instead of the OTQT, the 
fourth factor concerns the Consequences of the test for preservice teachers, 
and the fifth factor concerns theEmphasisplaced on the test by theOntario 
Ministry of Education, the initial teacher -education program, and the 
media. Theitems loading on each factor will be discussed in detail below. 

Some of the factors are moderately correlated. As Table 3 shows, the 
Other Tests and Consequences factors are correlated .388 Both of these 
factors are correlated with the Utility factor, .345 and .391, respectively. 
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Table 3 

CorrelationsAmong Factcrs 


Factor 



Factor 

1. Utility 

2 Preparation 

3 Other Tests 4. Consequences 

2 

Preparati on 

.141 



3. 

Other Tests 

.346 

.176 


4. 

Consequences 

.390 

.094 

.368 

5. 

Emphasis 

-.045 

-.098 

-.189 -.256 


indicating that preservice teachers who held more positive beliefs about 
theutility of the test also tended to support the creation of additional tests 
and the assignment of consequences based on this test The Preparation 
factor is the least correlated with the other factors, suggesting that 
preservice teachers' beliefs about appropriate test preparation activities 
and who should be responsible for test preparation were not related to 
their beliefs about the utility of the test and its appropriateness. The 
Emphasis factor is slightly negatively correlated with the other factors. 
The correlation between Emphasisand Consequences, for example, is-.25C 
meaning that preservice teachers who felt the test should not have serious 
consequences also tended to feel thatitwas receiving too much emphasis 
— and viceversa. 

I terns on theU ti I i ty Factor. TabI e 2al so reports the percentages of preservi ce 
teachers disagreeing, agreeing, and selecting "don’t know" for each of the 
items. Two thirds (664%) of preservice teachers disagreed that the reasons 
theOTQT was being administered wereimportant When asked aboutthe 
content of the test and the types of questions, 51. disagreed that the 
content was appropriate and 63C% disagreed thatthe types of questions 
were appropriate. However, 21. and 17.2% of preservice teachers 
responded "don't know" to these items. Many of these responses may 
have been the result of lack of exposure to information about the test 

Most respondents (832%) disagreed with the suggest! on that theOTQT 
will measure whatitis intended to measure. Because detailed information 
about the OTQT was difficult to find in the months preceding its first 
administration, preservice teachers and instructors were left to speculate 
about many of those d etai I s, from the pu rpose of the test to the d i ffi cu I ty of 
the items and likely pass scores. Responses to this item likely reflect the 
skepticism this speculation encouraged. 

When queried aboutwhether theOTQT would provide accurate results, 
even more — 8606 — disagreed, and only 1.1% agreed. Although the 
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desi gn of thequesti onnai re makes explori ng the reasons behi nd thi s strong 
belief impossible, it helps to explain the preservice teachers' high anxiety 
levels, and suggests somedirections for future research. I tis interesting to 
note that in response to the item abouttheOTQT's fairness across cultural 
groups, although a relatively lower percentage of respondents disagreed 
or strongly disagreed (634%), 2E% selected "don’t know," responses once 
again demonstrated a lack of darity about the test 

In response to the assertion thattheOTQT should notresultin pass or 
fail dedsions this year, 89^ agreed. When one traces the chronology of 
events surrounding theOTQT's implementation, itis easy to understand 
this reaction. Although the firstmention of the OTQT was in April 1909 
piloting only began in September 2001. Thislatedevelopmentled to much 
speculation about whether the test would take place for 2001/2X)2 
preservice teachers, and thelegality of its results if in factitdid takeplace. 

I terns on the Preparation Factor. Despite therespondents' negativeattitudes 
towards the OTQT, two thirds (67. agreed with the suggestion that 
preserviceteaohers should study for the test This is perhaps notsurpri sing 
because the respondents were attending an information session on the 
purpose and contentof the OTQT. 

Partidpants' responses to the assertion that initial teacher -education 
programs should align their curricxila to the test were split with 51.4% 
agreeing and 384% disagreeing. When asked whether programs should 
teacti test-taking skills, the majority of respondents agreed (56®6). An 
even higher percentage of the partidpants (77.1%) agreed that teactier- 
education programs should indude analyzing case studies in the 
curriculum. 

Items on the Other Tests Factor. Abouta quarter (252%) of respondents 
believed that some other certification test would increase the prestige of 
the teaching profession. When asked whether someother cartifi cation test 
would increase the quality of the teactiing profession, 258% agreed. 
Although these percentages are almost identical, they do notrepresentthe 
same students — only ^G&/o agreed with both statements. 

An examination of the Ministry's role in the testing process revealed 
almost an even split between respondents who disagreed with the 
d ev el opm ent of certi fi cati on tests that m easu re su bj ecT k nowl ed ge (42 2%), 
and those who agreed (38^). A higher number opposed the suggestion 
that the Ministry administer a test before a teacher candidate enters an 
initial teacher-education program (58®6). In other Jurisdictions, the 
introduction of an entranca examination has raised pass rates on the 
cartification tests by screening out at the earlier step candidates likely to 
fail the cartifi cation test Theresultfor preserviceteactiersis thatitismore 
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difficuIttDgetintDa program, butoncethey arein one, their probability of 
receiving certification is improved. 

Items on theConsequences Factor. Preservioeteaohers expressed the greatest 
uncertainty about the statement "I know preservice teachers who should 
fail the test" with 26®6 selecting "don't know." Almost half (452%) 
disagreed and only 23C% agreed. This hesitance to comment on other 
preservice teachers' ability may have been due to concerns about 
professionalism. In addition, most preservice teachers had not observed 
their peers teaching, and somay havefeitthey had inadequate information 
on which to make such a judgment 

Only 5®6ofthe respondents agreed thatpreservice teachers who failed 
the test should not receive a teaching certificate. Approximately the same 
number (4.^) agreed thatpreserviceteachers who fail the test should not 
be allowed to teach, even on an interim certificate. This response is not 
su rp ri si ng, becau se those stud ents who qu esti on the val i d i ty of the OT QT, 
using itto bar preservice teachers from teaching would beillogical. 

Almost two thirds (65^) of the respondents disagreed that teacher- 
education programs whose preservice teachers do poorly should be 
scrutinized by the Ontario College of Teachers, the professional body 
responsible for accrediting programs. 

I terns on the Emphasis Factor. When asked whether the Mi nistry was putti ng 
too much emphasis on theOTQT, 87.7% agreed. Regarding whether initial 
teacher training programs are putting too much emphasis on the OTQT, 
however, only 26G% agreed and 621% disagreed. These results are difficult 
to interpret because parti d pants who disagreed could be advocating less 
emphasis or could believe that the emphasis is already "Just right" 
U nfortunately, thewordingofthequestion does notallow ustodistinguish 
between these possibilities. About whether the media was putting too 
much emphasis on theOTQT, respondents were almost evenly split with 
38®6 agreeing and 41. ^disagreeing. A I most 22% (19®6) responded that 
they "don'tknow" 

The Rdati on ships BSween Experiences and Perceptions 

Exposure to information about the test did have an impact on some 
attitudes. Notably, those preservice teachers who had read the test 
sped fi cati ons were si gni fi canti y more I i kel y to agree that the content areas 
to be covered by the test are appropriate (352% vs. 16®6, x^(”l) =977, p < 
.01). In addition, only of those who had read the spedfications 
responded "don’tknow" to that statement compared with 31.7% of those 
who had notread the spedfications. 
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Preservice teachers who had read example or pilot or field test case 
stud i es were al so si gni fi canti y more I i kely to agree that the content areas to 
be covered by thetestare appropriate (294% vs. 17.7%, x^O) =7.85 p <.01). 
The percentages responding "don'tknow" tothisitem weresimilar: 204% 
and 24.®6. Interestingly, the preservice teachers who had seen cases were 
significantly less likely to agree that the Ontario Ministry of Education 
should develop subject area tests (37.C% vs. 45i&/o, x^(1) =7.0Q p <.01). 

Because almost all preservice teachers had been exposed to an in-dass 
discussion or workshop about the OTQT, it was not useful to compare 
those few who had not with those who had. 

Visiting the OPC and/or OMOE websites for information about the 
OTQT required someeffortbythepreserviceteachers,sodoing so suggests 
a higher level of i nterest i n the test Perhaps itis notsurprising, then, that 
significantly fewer of those who had visited the websites agreed that the 
medi a was putt! ng too much emphasi s on the OT QT (34. 1% vs. 43 x^(1) 
= 1093 p < .CD1). However, these preservice teachers' responses did not 
differ significantly on any other statements. 

Even though fewer than 1®6 of the preservice teachers had taken a 
standardized testsincehigh school, those who had thatexperiencediffered 
significantly intheirresponses to several items from those whodid notln 
particular, those with test-taking experience were significantly less likely 
to agree with "I know preservice teachers who should fail the OTQT" 
(151% vs. 26C%, x^(”l) = 592 p < .0^, more likely to agree that a teacher 
candid ate who fails that OTQT should not be allowed to teach, even on an 
interim certificate (97% vs. 37%, x^(1) = 505 p <.05), more likely to agree 
that teacher -education programs whose preservice teachers did poorly 
should be scrutinized (292% vs. 15C%, x^O) =4.64, p <.05), and lesslikely 
to agree that the test should not result in a pass/fail decision (85®6 vs. 
94.7%, x^(1) = 623 p < .05). Although these differences are not highly 
significant given thelarge number of comparisons being conducted, they 
aresuggestiveof differences in perception. In particular, those with personal 
test-taking experience were more likely to accept that the OTQT should 
have consequences for preservice teachers and teacher-edu cation 
programs. 

CONCLUSION 

Although the preservice teachers appeared to agree in principle with 
testing, they were hesitant to accept its application as the final step in the 
teacher certification process, primarily dueto concerns aboutits purpose, 
content and form. However, the preservice teachers varied widely in their 
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perceptions of the test Their exposure to information about the test and 
previous experience with large-scale testing appeared to affect their 
perceptions. In particular, students who had seen example test items and 
test specifications were more likely to agree that the content of the test 
was appropriate than those who had not This speaks well for the tests 
face validity, butunderlinestheimportanceof exposing preservice teachers 
to these materials. Those who had previously taken high-stakes, large- 
scaletests weremorelikely toaccepttheproposed consequences of thetest 
than those who had not 

Implications 

Initial teacher -education programs are increasingly under pressure to 
prepare preservice teachers to take certification tests. Although the 
consequences for Ontario programs are not yet dear, the pass rates by 
program are expected to be published. Whether publication of the results 
alone will pressure teacher -education programs to engage in formal test 
preparation activities or even to align their curricula with the test content 
remains to be seen. Whether additional pressures will be brought to bear 
by the Ontario College of Teachers when programs are re-accredited is 
also as yet unknown. 

Programs may resist defining their curricula based on a test's 
sped fi cati ons. Ifthecurrentcurriculaare based on careful judgments about 
what beginning teachers need to know and be able to do, to change the 
curricula would require compromising thosejudgments and, possibly, 
signal a willingness to make even more changes. However, other 
approaches to preparing preservice teachers to take a certification test are 
also possible. Luna et al.’s (23X)) use of a tests content to teach critical 
thinking about educational theories and analysis of the test developers' 
expectations was described earlier. Discussing the content that will be on 
the test familiarizing the students with the tests format and teaching 
test-taking strategies do requiretime, butnota realignment of curricula, 
and can go farin allayingpreservice teachers' worn esaboutthe test Indeed, 
more than half of the preservice teachers surveyed in this study believed 
thattheir program should prepare them for thetest Thatis not to say that 
they believeall the responsibility lies with theteacher-education program: 
Most also believed that preservice teachers should study on their own. 
Furthermore, their perceptions of appropriate test preparation activities 
and who should be responsible for test preparation were not related to 
their beliefs about the utility of the test and its appropriateness. 

The results of this study suggest that most preservice teachers were 
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skeptical aboutthe new test However, those with more information about 
the test tend ed to be I ess skepti cal . Fu rther, those wi th p revi ou s experi ence 
taking a large-scale, high-stakes test were more accepting of the test 
Although the survey did notask directiy how stressful the preservice 
teachers found preparing for the test our assumption is that perceptions 
that the test is unfair and inappropriate result in increased stress. As 
teacher -education programs consider whether and how to prepare their 
students for these tests, the stress preservi ce teachers may experi ence due 
simply to lack of knowledge aboutthe tests is important te bear in mind. 

Li mitations 

This study has a number of limitations. The preservice teachers who 
completed the questionnaire were from a single initial teacher -education 
program, al beitthe largest in Ontario. In addition, they were not a random 
sampleofthepreservice teachers studying in thatprogram. The extent to 
which they are representative of preservice teachers in the particular 
program, and across the province, is difficult to judge, although the 
distributions by gender and panel are typical. 

The survey was conducted during thefirstyear of the testing program. 
Follow-up studies are needed to determine whether exposure to 
i nformation aboutthe test and percept ons of the test change as the test ng 
program matures and the stakeholders become more accustomed to it 

Finally, this study relies on preservice teachers' reporting of their 
experiences and perceptions. Thequestionsaboutexperiences, in particular, 
may not have been interpreted in the same way by all respondents. For 
example. Bower (2303), in a study of teacher educators and preservice 
teachers preparing for the OTQT, found that the preservice teachers’ and 
teacher educators' perceptions of the same test preparation activities did 
not always agree. 

FutureDirections 

Although over 9C% of the students reported discuss! ngtheOTQT intheir 
teacher -education courses, the content and extent of these discussions 
were not explored. A study of test preparation activities across and within 
teacher -education programs would help educators understand the 
variation in activities. In addition, a comparison between the test 
specifications and the initial teacher-education programs' curricula 
would providevaluableinformation both aboutthepreservice teachers' 
opportunity to learn the material to be tested and about the possible 
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impact of the test on theprograms. 

Preservice teachers' anxiety about teacher certification testing and the 
determinants of thatanxiety arenotwell understood. If teacher -education 
programs are to prepare preservice teachers to take certification tests, 
they will likely be more effective if they are able to identify and address 
the determinants. 

This study suggests that previous test-taking experience affects 
perceptions of teacher certification tests. For those preservice teachers 
who do not have any similar experiences, would providing practice 
opportunities in an environment similar to what they will face in the 
actual licensure test be helpful? 

We expect the results of this study and of such future research to be of 
i nterest beyond Ontario, as other provinces and states search for ways to 
address initial teacher certification testing in teacher -preparation 
p rograms. A s we better u nd erstand how the preserv i ce teachers experi ence 
preparation for such tests, and how they perceive the experience, we will 
gain a valuable perspective on the implications of certification testing 
both for preservice teachers and for initial teacher -education programs. 
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